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® Process for judging a runway. 



(g) There is disclosed a process for judging a run- 
way on a two-dimensional image display presenting 
image information obtained by taking a picture of the 
runway. The process comprises a first step of set- 
ting a first window (WDiJ and a second window 
(WDir) for scanning and tracing required parts of the 
runway on the image display, and setting a third 



window (WDic) interlocked with the first and the 
second windows in a set positional relationship 
therewith, and a second step of, when the third 
window detects a required part of the runway (Eoc), 
changing a scanning area of the third window to the 
surrounding of the required part of the runway. 
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PROCESS FOR JUDGING A RUNWAY 



This invention relates to a runway judging pro- 
cess, specffically to a process for judging the con- 
tour of the runway, based on image information 
obtained by taking a picture of the runway. 

To drive automatically a vehicle (e.g., auto- 
mobile) on a runway (e.g.. road), it is necessary to 
recognize and judge the contour of the road in real 
time. In such a conceivable runway judging pro- 
cess, for example, a road ahead of an automobile 
is pictured by a TV camera, or the like, and the 
obtained data is image-processed. 

Fig. 1A - F show image displays of a road 
whose contour is to be judged. In Rg. 1A - F. HL 
indicates a horizon, and RL and LL indicate the 
right and the left edges of the road respectively. 
SR represents a fork of the road. Contours of the 
road are a straight road (Fig. 1A), a curved road 
(Fig. 1B). a forked road (Fig. 10), a branch divided 
from a main road Fig. ID. and branches joined to 
main roads (Figs. IE and F). 

It is not easy to recognize such variations of 
the contour of a runway. 

In a conceivable process', for example, the 
edges corresponding to the sides RL, LL of a 
runway are extracted at the lower end of an image 
display, i.e.. on the foreground of a road, and 
based on the extracted result, the sides RL, LL are 
traced upward on the image display, i.e., forward of 
the runway. But it is very difficult to recognize the 
branches exemplified in Rgs. 1C and D by this 
process. 

When a recognition error takes place at the 
start or in the course of image data processing for 
the recognition, it becomes impossible to judge the 
contour of a road. Here it is assumed that a pro- 
cess is used in which the edges corresponding to 
the sides of a runway are extracted at the lower 
end of an image display of the road, i.e.. on the 
foreground of the road, and based on the extracted 
result, the right and the left sides of the road are 
traced upward on the image display, i.e.. forward of 
the road. In this process, for example when the 
edge corresponds to the left side of the road, it is 
impossible to trace the left edge upward on the 
image display. 

A first object of this invention is to provide a 
runway judging process which can judge variations 
of the contour of a runway easily and with high 
precision. 

A second object of this invention is to provide 
a runway judging process which can judge vari- 
ations of the contour of a runway with no errors 
and easily. 

The runway judging process according to a 
first aspect of this invention is for judging a runway 
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on a two-dimensional image display presenting im- 
age Information obtained by taking a picture of the 
runway, the process being characterized by the 
first step of setting a first window and a second 
5 window for scanning and tracing required parts of 
the runway on the image display, and setting a 
third window interlocked with the first and the sec- 
ond windows in a set positional relationship there- 
with; and the second step of. when the third win- 
70 dow detects a required part of the runway, expand- 
ing a scanning area of the third window to the 
surrounding of the required part of the runway. This 
runway judging process may be characterized by 
the second step of, when the third window detects 
75 the required part, expanding its scanning area to 
the surrounding thereof to detect a V-shape. 

According to this runway judging process, local 
areas defined by the first to the third windows are 
processed, and accordingly the data to be pro- 
20 cessed are decreased. The expansion of the scan- 
ning area of the third window facilitates judging 
variations of the contour of a runway. 

The runway judging process according to a 
second aspect of this invention is characterized in 
25 that right and a left windows are set respectively at 
the right and the left sides of the runway on the 
foreground of the image display, and the right and 
the left windows are moved forward along the sides 
in the direction of run of the runway for scanning 
30 and tracing the runway, while setting a central 
window intermediate between the right and the left 
windows for scanning a different edge of the run- 
way. When the central window detects the different 
edge of the runway, the central window is set at a 
35 downward position of the image display (rearward 
of the runway) to scan and trace the detected 
different edge. This runway judging process may 
be characterized in that when the central window 
detects the runway, the central window is set at a 
40 downward position of the image display (rearward 
of the runway) to scan and trace the runway, and 
when the central window detects the vertex of a V- 
shape, the scanning and tracing is branched to the 
right and to the left. 
45 According to this runway judging process, the 

edges of a runway are scanned by setting a right, a 
left and a central windows, and accordingly the 
data to be processed are decreased, and the pro- 
cessing is speeded up. The processing operations 
50 by these windows (small areas) are accumulated to 
recognize the entire contour of a runway, with 
theresult that the runway can be judged with high 
precision. When the central window detects a dif- 
ferent edge, the backward processing is conduct- 
ed, with the result that various contours of runways 
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can be judged accurately and easily. A V-shape is 
detected by the backward processing performed 
when the central v/indov/ had detected, with the 
result that variations of the contour of a road, such 
as divided branches and joining branches can be 
detected easily. 

The runway judging process according to a 
third aspect is for judging a runway on a two- 
dimensional image display presenting image in- 
formation obtained by taking a picture of the run- 
way, the process being characterized by the first 
step of setting a first window and a second window 
for scanning and tracing required parts of the run- 
way on the image display, and setting a third 
window interlocked with the first and the second 
windows in a set positional relationship therewith: 
and the second step of. when the third window 
detects a required part of the runway, expanding a 
scanning area of the third window to the surround- 
ing of the required part so as to detect possible 
errors of the scanning of the required parts con- 
ducted by the first and the second windows. 

According to the runway judging process, local 
areas of a first to a third windows are to be pro- 
cessed, and accordingly the data to be processed 
are decreased. The third window can be expanded 
to scan errors made by the first and second win- 
dows, with the result that the contour of a road can 
be judged accurately and easily. 

The process for judging a runway according to 
a fourth aspect is characterized in that a right and a 
left windows respectively on the right and the left 
sides of the runway on the image display are set. 
additional right and left windows are set sequen- 
tially in the direction of run of the runway to scan 
and trace the runway, while a central window is set 
intermediate between the right and the left windows 
to scan a different edge of the runway. This pro- 
cess is further characterized in that when the cen- 
tral window detects a different edge, a central 
window is set at a downward position on the image 
display (rearward of the runway) to scan and trace 
the detected different edge to detect scanning er- 
rors made by the right and the left windov/s. 

According to this runway judging process, a 
right, a left and a central windows are set to scan 
the edges of a runway, with a result that the data to 
be processed are decreased, and the processing is 
speeded up. The processing operations of these 
windov/s (small areas) are collected to recognize 
the entire contours of the runway, with theresult 
that the runway can be recognized with high preci- 
sion. When the central window detects a different 
edge of the runway, the backward processing is 
performed to detect scanning errors of the right 
and left windows, with the result that the contour of 
the runway can be judged accurately and easily. 
The present invention will become more fully 



understood from the detailed description given 
hereinbelow and the accompanying drawings which 
are given by way of illustration only, and thus are 
not to be considered as limiting the present inven- 
5 tion. 

Further scope of applicability of the present 
invention will become apparent from the detailed 
description given hereinafter. However, it should be 
understood that the detailed description and spe- 

10 cific examples, while indicating preferred embodi- 
ments of the invention, are given by way of illustra- 
tion only, since various changes and modifications 
within the scope of the invention will become ap- 
parent to those skilled in the art from this detailed 

75 description. 

Brief Description of tlie Drawings 

20 Fig. lA - F are views of variations of a 

runway to be judged; 

Fig. 2 is a diagrammatic view of a system in 
which runway judging process of the present inven- 
tion may be used; 
25 Fig. 3 is a view explaining the pre-process- 

ing in patterns; 

Fig. 4A - H are views explaining the edge 
tracing processing; 

Fig. 5A - D are views explaining the con- 
30 secutive small area tracing window processing; 

Fig. 6 is a flow chart of the general process- 
ing of the runway judging process according to the 
first embodiment; 

Fig. 7 is a flow chart of the initiation process- 
es ing; 

Fig. 8 is a flow chart of the left.(right) tracing; 
Fig. 9 is a flow chart of the central process- 
ing; 

Fig. 10 is a flow chart of the backward pro- 
40 cessing; 

Fig. 1 1 is a flow chart of the V-shape scan- 
ning processing; 

Fig. 12A - C are views explaining the initial- 
ization processing, and the setting of the windows; 
45 Fig. 1 3A - B are views explaining the setting 

of the central window, and the edge scanning; 

Fig. 14 is a view explaining a major part of 
the runway judging process according to a first 
embodiment of this invention; 
50 Fig. 15A - D are views explaining the V- 

shape scanning processing related to a major part 
of a second embodiment of this invention; and 

Fig. 16A - D are views explaining the scan- 
ning error detection performed by a major part of a 
55 third embodiment of this invention. 

In Fig. 2, a camera 11 takes a picture of a road 
in the forward direction to supply an output of 
analog image data. This output is converted to 256 
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gradation-digital image data by an A/D converter 
board 12. Then the digital image data is space- 
differentiated by a Sobei board 13 so that parts, 
i.e.. edges where the darkness of the image display 
abruptly changes, are detected. The processing 
result of the Sobei board 13 is stored by a mul- 
tivalued memory 14 in 256 gradations. Then the 
multivalued memory 14 supplies its stored data to 
a binary board 15 and is stored by a binary mem- 
ory 16 in binary data (0. 1). 

The processing operations executed by the 
system from the camera 11 to the binary memory 
16 are referred to as pre-processing. This pre- 
processing is shown in patterns in Fig. 3. A mobile 
analog image taken by the camera 11 is digitized 
first along the space and the time axes and then is 
digitized into 258 gradations with respect to the 
darkness. Subsequently the digitized image is two- 
valued to produce binary image data of 512 x 512 
picture elements. The processing, i.e.. main pro- 
cessing on this binary image data is performed by 
CPU 17 in Fig. 2. 

Next, before the main processing is explained, 
the tracing processing and the window processing 
used in the process for judging a runway according 
to this invention will be explained. 

To process an image it is essential to extract a 
feature, e.g., a boundary line, etc. of an object from 
the image. One of the typical features on the image 
represents an edge. In this embodiment, for ex- 
tracting an edge, an image is space-differentiated 
to detect the edge. The edge is detected at a 
position where a feature (generally gray level) ab- 
ruptly changes, and the edge defines the bound- 
ary, i.e., contour of an object. To be specific, a 
white line i.e.. a shoulder line of a road abruptly 
changes darkness on the image display, which 
permits the edge to be detected, and consequently 
a side of the road can be recognized. 

(Consecutive tracing processing) 

An edge detected by extracting the feature is 
detected as a line by the following consecutive 
tracing processing. 

(Step-i) Select a picture element for initiating a 
consecutive tracing processing operation: 

(Step-ii) Scan a next picture element to be 
processed, based on an immediately preceding 
processed picture element, and perform required 
processing on the next picture element. 

(Step-iii) Repeat Step-ii when a further next 
picture element is processed, or otherwise finish 
the consecutive tracing processing operation. 

This tracing processing is characterized tirstly 
in that which picture element is to be processed 
depends on a result, i.e.. the position of an initial 
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picture element, of the pre-processing preceding 
the tracing processing, and secondly In that the 
processing area can be restricted by using the 
result of the preceding pre processing, with results 

5 that it is possible to remove wasteful processing 
and improve the processing precision. 

Examples of the tracing processing will be 
briefly explained with reference to Rgs. 4A - H. It is 
assumed that an edge to be traced (not "0" but 

10 "1" of binary data) is positioned as indicated by 
the hatchings in Rg. 4A. An initial picture element 
is chosen as indicated by the cross hatching in Fig. 
4B to scan for picture elements which are continu- 
ous to this initial picture element This scanning 

75 operation is performed on the picture elements 
marked by ('). and the edge is detected on a next 
picture element as in Fig. 4C. The next scanning 
operation for the edge is performed in an antici- 
pated direction of the edge as Indicated by the 

20 marks (") in Fig. 4C. As indicated by Figs. 4D. E 
and F. the scanning operation is repeated to detect 
the edge in the areas restricted by the processing 
results of the preceding scanning operations. 

But. here in Fig. 4F. the edge is absent on the 

25 continuous picture elements, and the tracing pro- 
cessing operation cannot be performed. In this 
case, the scanning area is jumped by one picture 
element as in Fig. 4G. Then the edge can be 
detected as in Fig. 4H. If the edge cannot even be 

30 detected with one picture element jumped, two 
picture elements are jumped. 



(Window processing) 

35 

in this invention, an edge is not traced over the 
entire image display but over a part of the image 
display by window processing. This makes it possi- 
ble to take out to process a part of the image 
40 display where an object is present. In addition, in 
this invention, the contour of an object is extracted 
based on the above-described consecutive tracing 
processing. 

(Step-i) Set a window to be processed, based 
45 on a picture element satisfying suitable conditions; 

(Step-ii) Scan picture elements to be pro- 
cessed with the picture element in Step-i set as the 
initial picture element, and trace the edge to scan 
picture elements to be processed next; 
50 (Step-iii) Repeat Step-ii when the traced picture 

element is inside the window. Return to Step-i to 
set an additional window when the traced picture 
element is outside the window. Jump some picture 
elements in the direction where the edge is antici- 
55 pated to be present when the edge is interrupted, 
and horizontally scan the edge. 
(Step-iv) Repeat Step-ii. 

This window processing is characterized in 

4 
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that; first, since this window processing uses the 
result of the preceding processing operation, it is 
possible to restrict the area of the window process- 
ing, and accordingly wasteful processing is re- 
moved; second, setting the processing window 
keeps the processing away from the influences of 
information outside the processing window; third, 
elaborate tuning can be performed depending on 
arrangements of the processing window; and. 
fourth, this window processing is effective for inter- 
rupted lines. 

Next, an* example of the consecutive small win- 
dow tracing processing will be explained with refer- 
ence to Fig. 5A - D. 

First, as shown in Rg. 5A, a window WDi is set 
with a picture element Gi which has been traced in 
the preceding processing operation centered. Then 
the tracing processing operation is repeated only in 
this window WDi, and when a picture element G2 
which is the first outside the window WDi is deter- 
mined, as shown in Fig. 5B, an additional window 
WD2 is set with the picture element G2 centered. 
The tracing processing operation is repeated by 
the window WD2 in the same way as by the 
window WDi . Here it is assumed that, as shown in 
Fig. 5C. the edge continuous to .that of the picture 
element Ga is detected neither on the adjacent 
picture elements nor on the picture elements 
jumped by one picture element. In this case, as 
shown in Fig. 15B, one additional window WD3 is 
set on the window WD2, and the edge is scanned 
on the picture elements indicated by f) '^i Fig. 5C. 
Then the edge is detected on the picture element 
G4 as in Fig. 5D. With the picture element G* set 
as a basic point, the scanning operation is repeated 
in the window WD3. When a final picture element 
G5 is detected in the window WD3. an additional 
window WD4 is set on the window WD3. 

Next, the main processing of the runway judg- 
ing process according to this embodiment will be 
explained. 

Rg. 6 is a general flow chart of the main 
processing. As shown, the main processing com- 
prises initiation processing (Step 601) shown in 
detail in the flow chart of Fig. 7, left tracing and 
right tracing (Steps 602 and 603) including the left 
(right) side tracing shown in detail in the flow chart 
of Fig. 8. and center processing (Step 604) includ- 
ing center scanning detailed by the flow chart of 
Fig. 9. When the center scanning of Step 604 
detects an edge, backward processing shown by 
the flow chart of Rg. 10 and V-shape tracing shown 
by the flow chart of Fig. 1 1 are executed. 

The initiation processing will be explained in 
good detail with reference to Figs. 7 and 12A - C. 

A camera 1 1 is placed on a vehicle at a suit- 
able height. When the camera 11 is faced in the 
direction of run of the road, the white lines on the 
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right and the left sides of the road (the edges of 
the road RL. LL) are positioned respectively on the 
right and the left of the center of the image display 
as shown in Fig. 12A. Based on this natural ar- 

5 rangement. initial windows WDql'. WDqr are set 
respectively on the left and right sides of the bot- 
tom of the image display (when a car is partially 
present In the image display. Immediately above 
the car) (Step 701 in Fig. 7). Then follow the 

70 processing operations of Steps 702 - 705 in Fig. 7, 
and those of Steps 706 - 709 of Fig. 7 continu- 
ously. That is, since the edges are absent inside 
the road, the interiors of the initial windows WDol , 
WDor are scanned outward from the respective 

75 sides nearer to the center, and the first edges to be 
detected are the sides of the runway in the form of 
the white lines (RL, LL). When a mass of some 
edges is detected, the edges are judged to be the 
white lines corresponding to the sides RL, LL of the 

20 runway, taking into consideration that there are 
actually small noises on the road, i.e., Gb. Gc in 
Figs. 12 B and C (Steps 702 and 706). 

When the edges in the form of the white lines 
of the road are detected, the upward, i.e.. forward 

25 of the road, tracing starts and ends at the position 
immediately outside the initial windows WDql . 
WDor. When one scanning operation cannot detect, 
the edges, the same scanning operation is re- 
peated within the initial windows WDql . WDqr at 

30 an upper position by some picture elements until 
the edges are detected or the initial windows WDql 
, WDqr run out. When the edges cannot be de- 
tected within the initial window WDql. (Steps 703 
and 707) as shown in Figs. A and B. a phantom 

35 tracing point Eql is set at the upper outer corner of 
the initial window WDql. which is treated as If the 
edge has been detected (Steps 705 and 709). But 
this phantom tracing point Eql is not outputted in a 
line of points. 

40 The left (right) tracing will be explained with 

reference to Rgs. 8. 12A - C and 13A and B. 

Based on the edges. I.e.. Eql . Eqr in Fig. 12A. 
traced in the initiation processing, smaller right and 
left windows WD,l WD,r are set respectively on 

45 the initial windows WDql . WDqr The smaller right 
and the smaller left windows WDil. WDir are so 
set that initial picture elements are at the center of 
the bottom of the respective windows. In the follow- 
ing tracing operations, a small area is set in the 

50 same way as described above, based on the edge 
traced in their preceding operations. The right and 

the left windows WD^ . WDjl WD,r , WDzr' 

are made smaller than the initial windows WDql . 
WDqr for decreasing the influence of noises. When 

55 set windows WD are partially out of the image 
display, the windows are set nearer to the center of 
the image display so as to be within the image 
display. 

5 
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In a window WD, the above-described tracing 
processing is started on the in'rtial picture elements 
and ends at a position immediately outside the 
window, and then additional windows are set. The 
scanning is performed basically in the unit of win- 
dow alternately on the right and the left as shown 
in Fig. 6. The central processing which will be 
explained later is performed once every respective 
right and left tracing operation. A scanning opera- 
tion ends when the edge is completely lost, or 
when numbers of set right and left windows reach 
preset numbers (they are counted from the position 
of the horizon). A phantom scanning point is set as 
in the Initiation processing (Step 803) only when 
the edge has gone out of the Image display at the 
right and the left sides thereof during a tracing 
operation of the edge (Step 802). This makes it 
possible to detect an edge which has gone out of 
the image display and returns again thereinto. 

Next, the central processing which is a major 
part of this invention will be explained with refer- 
ence to Figs. 9 and 13A and B. 

In the central processing in Fig. 9 are per- 
formed position computation for setting a central 
window (Step 901). setting the central window 
(Step 902). and center scanning (Step 903). The 
central processing will be explained with reference 
to Fig. 13A and B. A position is determined which 
is upper by "b" of a middle point between the right 
and the left windows WDil . WD,r spaced from 
each other by "2a" on the image display, and at 
this position is set a central window WDic i^'^Q- 
13A). The scanning operation within the central 
window WDic is basically the same as in the 
Initiation processing but differs from the latter in the 
following two points. First. In the central process- 
ing, a scanning initial picture element is set at the 
upper left corner of the window WDic. and the 
scanning is performed to the right. Second, the 
scanning is jumped downward so as to speed up 
the processing. Every time one cycle of scanning 
ends, an additional central window WDac • WD„c 
are set as shown in Fig. 138. 

The backward processing (Step 904) in Fig. 9 
is executed as shown in Fig. 14. 

This backward processing is for detecting the 
edge Eqc by the central window WDnc as shown in 
Fig. 14 and tracing the edge downward for the 
purpose of detecting the edge Evp at the vertex of 
a V-shape. The edge Eqc. which has been detected 
by the central window, is traced downward by the 
backward processing by windows WD^b -WD4B. 
and when the vertex of the V-shape is detected, 
the backward processing ends. Meanwhile, on the 
other hand, the tracing operations by the right and 
the left windows WDnt', WDnR are at pause until 
the backward processing, and the V-shape and the 
right and left- tracing points are reset. Whether or 
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not the edge Evp is the vertex of the V-shape is 
determined by whether or not the edge continues 
downward on the image display. When the edge is 
interrupted, the position is judged to be the vertex. 

5 Whether or not the edge is interrupted is deter- 
mined by setting one additional window (WDsb) 
further downward from the position of the interrup- 
tion and detecting none of the edge. 

The V-shape tracing processing In Fig. 9 (Step 

10 905). i.e., a major part of a second embodiment of 
this invention, is executed as shown in Figs. 15A - 
B. 

To extract the V shape in Fig. 15A. the window 
WD,v at the vertex of the V-shape is branched into 

IS upper right windows WDgRv - WDiRv and upper left 
windows WD2LV - WDiLv to trace edges as shown in 
Fig, 15C. The division of the tracing direction into 
the right and the left is detected by tracing first 
either of the right and the left picture elements. For 

20 example, in Fig. 15 D. when the edge is traced to 
the left, the scanning operation is started on the 
picture element (1) in FIG. 15D. and a tracing 
operation is conducted in the direction of the pic- 
ture element (2) first detected. When the edge is 

25 traced to the right, oppositely a scanning operation 
is started on the picture element (5), and a tracing 
operation is conducted in the direction of the pic- 
ture element (4) first detected. The distance to be 
traced over is set small enough to recognize the 

30 contour of the V-shape, and in this embodiment 5 
picture elements are set respectively on the right 
and the left sides. 

In this embodiment, to recognize a branch 
uniquely and simply, after one V-shape has been 

35 extracted, the right and the left edges of the road 
are set anew in accordance with the direction of 
drive inputted beforehand, and the tracing opera- 
tion proceeds. Thus, even when there are several 
branches on one image display, these branches 

40 can be recognized one by one. 

The backward processing executed by a major 
part of a third embodiment of this invention is as 
shown in Fig. 16A - D. 

In this backward processing, an edge Is de- 

45 tected by the scanning operation by a central win- 
dow WD7C as shown in Fig. 16A, and a tracing 
operation is performed downward. This backward 
processing is for detecting the sides of a road 
which has escaped the processing by a left win- 
so dow. i.e.. the left side of road the left window has 
failed to scan. That is. when a left window traces 
an edge outside the road due to a scanning error 
of the left window, as shown In Fig. 16A, a central 
window WDyc can detect the left edge, because 

55 the central window scans the center between the 
phantom scanning point of the left window and the 
edge detected by a right window. Then, the scan- 
ning operations by the right and the left windows 
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are stopped, the scanning continues in Fig. 168 to 
trace the edge down to the most bottom of the 
image display. When a central window has con- 
ducted the tracing to the most bottom of the image 
display, the position of the central window there is 
judged to be the left edge if it is left from the 
center of the image display, and when the position 
is right from the center of the image display, it is 
judged to be the right edge. The line of edge 
points (phantom scanning points) on the erroneous 
side (left side) is cut off, using the line of edge 
points traced by the backward processing. That is, 
the line of the edge points traced In the backward 
processing is the left side. Then, as shown in Fig. 
16C, a scanning operation proceeds with an edge 
Eqc set as a tracing initiating position of the left 
window. Rg. 16D shows the lines of the edge 
points given by the above-described processing. 

The above-described scanning operation on 
one side of a runway is not limited to the left side 
but may be performed on the right side in the 
same way. The central windows can detect a scan- 
ning error when an intermediate right or left window 
fails to scan an edge as well as when it fails in the 
initial right or left window. 

From the invention thus described, it will be 
obvious that the invention may be varied in many 
ways. Such variations are not to be regarded as a 
departure from the scope of the invention, and all 
such modifications as would be obvious to one 
skilled in the art are intended to be included within 
the scope of the following claims. 



Claims 

1. A process for judging a runway on a two- 
dimensional image display presenting image in- 
formation obtained by taking a picture of the run- 
way, the process comprising: 

a first step of setting a first window and a second 
window for scanning and tracing required parts of 
the runway on the image display, and setting a 
third window in a set positional relationship with the 
first and the second windows, and 
a second step of, when the third window detects a 
required part of the runway, changing a scanning 
area of the third window to the surrounding of the 
required part of the runway. 

2. A process for judging a runway according to 
claim 1, wherein the third window set in the first 
step is for scanning the required part of the runway 
between the first and the second windows. 

3. A process for judging a runway according to 
claim 1 . wherein the second step is for shifting the 
scanning area of the third window to the fore- 
ground. 

4. A process for judging a runway for judging 
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the contour thereof on a two-dimensional image 
display presenting image information obtained by 
taking a picture of the runway, the process com- 
prising: 

5 a first step of setting a right window and a left 
window for scanning the right edge and the left 
edge of the runway respectively on the image 
display, and setting between the right and left 
windows a central window for scanning a different 

10 edge of the runway; 

a second step of setting additional right and left 
windows respectively one after another in the direc- 
tion of extension of the right and left edges to scan 
and trace the right and left edges in a scanning 

75 operation by the right and left windows, and setting 
intermediate between the right and left windows 
additional central windows one after another for 
scanning the different edge of the runway; and 
a third step of. when one of the central windows 

20 detects the different edge of the runway, setting 
additional central windows so as to scan and trace 
and detect the detected different edge toward the 
foreground, 

5. A process for judging a runway according to 
25 claim 4. wherein the third step comprises, when 

one of the central windows detects the different 
edge of the runway, changing a scanning area of 
the central window to the surrounding of the de- 
tected different edge so as to detect the V-shape 
30 of the detected different edge. 

6. A process for judging a runway according to 
claim 4 or 5, wherein the first step comprises 
setting the central window a little forward of the 
runway between the right and the left windows. 

.35 7. A process for judging a runway according to 

claim 4, 5 or 6 wherein the second step comprises 
conducting the scanning operation and the setting 
operation of the additional right and left windows 
alternately on the right and the left sides. 
40 8. A process for judging a runway according to 

any of" claims 4 to 7. wherein the third step con- 
ducting the scanning and tracing operation of the 
central windows toward the foreground with the 
scanning operation of the right and the left windows 
43 paused. 

9. A process for judging a runway according to 
claim 8. wherein the third step comprises changing 
the scanning area of the central window to the 
foreground so as to detect the vertex of the V- 

50 shape. 

1 0. A process for judging a runway according 
to claim 8 or 9, further comprising a fourth step of, 
when the detected different edge of the runway 
scanned and traced in the third step terminates, 

55 branching the scanning area at the vertex of the V- 
shape to the right and the left to scan and trace the 
detected different edge of the runway. 

1 1 . A process for judging a runway according 

7 
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to claim 10, wherein the fourth step comprises 
conducting the branched tracing to the right and 
the left by a set number of windows. 

12. A process for judging a runway on a two- 
dimensional image display presenting image in- s 
formation obtained by taking a picture of the run- 
way, the process comprising: 

a first step of setting a first window and a second 

window for scanning and tracing required parts of 

the runway on the image display, and setting a w 

third window in a set positional relationship with the 

first and the second windows, and 

a second step of. when the third window detects a 

required part of the runway, changing a scanning 

area of the third window to the surrounding of the is 

required part so as to detect possible errors of the 

scanning of the required parts conducted by the 

first and the second windows. 

13. A process for judging a runway according 

to claim 12. wherein the third window set in the first 20 
step is for scanning a required part of the runway 
between the first and the second windows. 

14. A process for judging a runway according 
to claim 12 or 13, wherein the second step com- 
prises changing the scanning area of the third 25 
window to the foreground so as to detect possible 
errors of the scanning of the required parts. 

1 5. A process for judging a runway for judging 
the contour thereof on a two-dimensional image 
display presenting image information obtained by 30 
taking a picture of the runway, the process com- 
prising: 

a first step of setting a right window and a left 
window for scanning the right edge and the left 
edge of the runway respectively on the image 35 
display, and setting between the right and left 
windows a central window for scanning a different 
edge of the runway; 

a second step of setting additional right and left 
windows respectively one after another in the direc- 40 
tion of extension of the right and left edges to scan 
and trace the right and left edges in a scanning 
operation by the right and left windows, and setting 
intermediate between the right and left windows 
additional central windows one after another for 45 
scanning the different edge of the runway; 
a third step of, when one of the central windows 
detects the different edge of the runway, setting 
additional central windows so as to scan and trace 
the detected different edge toward the foreground: so 
and 

a fourth step of, when the detected different edge 
being scanned and traced toward the foreground 
by the central windows emerges into either of the 
edges being scanned by the right and the left 55 
windows, judging the detected different edge as 
the right or the left edge respectively. 

16. A process for judging a runway according 



to claim 15. wherein the first step comprises set- 
ting the central window a little forward of the run- 
way between the right and the left windows. 

17. A process for judging a runway according 
to claim 15 or 16, wherein the second step com- 
prises conducting the scanning operation and the 
setting operation of the additional right and left 
v/indows alternately on the right and the left sides. 

18. A process for judging a runway according 
to claim 15, 16 or 17 wherein the third step com- 
prises conducting the scanning and tracing opera- 
tion of the central windows toward the foreground 
with the scanning operation of the right and the left 
windows paused. 
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image information obtained by taking a picture of the 
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window detects a required part of the runway (Eoc). 
changing a scanning area of the third window to the 
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